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ABSTRACT 

The success of model-based approaches to systems health 
management depends largely on the quality of the underly- 
ing models. In model-based prognostics, it is especially the 
quality of the damage progression models, i.e., the models 
describing how damage evolves as the system operates, that 
determines the accuracy and precision of remaining useful life 
predictions. Several common forms of these models are gen- 
erally assumed in the literature, but are often not supported 
by physical evidence or physics-based analysis. In this paper, 
using a centrifugal pump as a case study, we develop differ- 
ent damage progression models. In simulation, we investigate 
how model changes influence prognostics performance. Re- 
sults demonstrate that, in some cases, simple damage progres- 
sion models are sufficient. But, in general, the results show 
a clear need for damage progression models that are accurate 
over long time horizons under varied loading conditions. 

1. Introduction 

Model-based prognostics is rooted in the use of models that 
describe the behavior of systems and components and how 
that behavior changes as wear and damage processes oc- 
cur (Luo, Pattipati, Qiao, & Chigusa, 2008; Saha & Goebel, 
2009; Daigle & Goebel, 2011). The problem of model-based 
prognostics fundamentally consists of two sequential prob- 
lems, (0 a joint state-parameter estimation problem, in which, 
using the model, the health of a system or component is de- 
termined based on its observations; and (ii) a prediction prob- 
lem, in which, using the model, the state-parameter distri- 
bution is simulated forward in time to compute end of life 
(EOL) and remaining useful life (RUL). The model must de- 
scribe both how damage manifests in the system observations, 

Daigle et al. This is an open-access article distributed under the terms of 
the Creative Commons Attribution 3.0 United States License, which permits 
unrestricted use, distribution, and reproduction in any medium, provided the 
original author and source are credited. 


and how damage progresses in time. Clearly, the prognostics 
performance inherently depends on the quality of the models 
used by the algorithms. 

In modeling the complex engineering systems targeted by 
prognostics algorithms, many modeling choices must be 
made. In particular, one must decide on the appropriate 
level of abstraction at which to model the system in order 
to estimate system health and predict remaining life. The 
choice is mainly one of model granularity, i.e., the extent 
to which the model is broken down into parts, either struc- 
tural or behavioral. The selected models must then provide 
enough fidelity to meet the prognostics performance require- 
ments. But, model development cost, available level of ex- 
pertise, model validation effort, and computational complex- 
ity all constrain the models that may be developed. For ex- 
ample, finer-grained models may result in increased model 
fidelity and thus increased prognostics performance, but may 
take more effort to construct and increase computational com- 
plexity. Therefore, a clear need exists to investigate the im- 
pact of such modeling choices on prognostics performance. 

In this paper, we use a centrifugal pump as a case study with 
which to explore the impact of model quality on prognos- 
tics performance. Typically, developing a reliable model of 
nominal system operation is relatively straightforward, as the 
dynamics are usually well-understood in terms of first prin- 
ciples or physics equations, and, most importantly, there is 
typically sufficient data available with which to validate this 
model. The major difficulty lies in developing models of dam- 
age progression, because these models are often component- 
dependent, and so the understanding of these processes is gen- 
erally lacking. Further, the data necessary to properly vali- 
date these models are, in practice, rarely available. Using the 
pump model, we develop several damage progression mod- 
els and evaluate their effect on prognostics performance using 
simulation-based experiments. To the best of our knowledge, 
this, along with a companion paper exploring these issues 
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with application to battery health management (Saha, Quach, 
& Goebel, 2011), is the first time this type of analysis has 
been performed within the context of prognostics. 

The paper is organized as follows. Section 2 describes the 
model-based prognostics framework. Section 3 presents the 
modeling methodology and develops the centrifugal pump 
model with several damage progression models. Section 4 
generalizes the different models within the framework of 
model abstraction. Section 5 describes the particle filter- 
based damage estimation method, and Section 6 discusses 
the prediction methodology. Section 7 provides results from 
a number of simulation-based experiments and evaluates the 
effect of the different damage progression models on prog- 
nostics performance. Section 8 concludes the paper. 

2. Model-based Prognostics 

We assume the system model may be described using 

x(f) = f(f,x(f),0(f),u(f),v(f)) 
y (t) = h(f,x(f),0(f),u(f),n(f)),. 

where x(f) £ R”* is the state vector, 0(f) £ R n# is the pa- 
rameter vector, u(f) £ R"“ is the input vector, v(f) £ R" 1 ’ is 
the process noise vector, f is the state equation, y (t) £ R. Hy is 
the output vector, n(t) £ R n " is the measurement noise vec- 
tor, and h is the output equation. The model may be nonlinear 
with no restrictions on the functional forms of f or h, and the 
noise terms may be nonlinearly coupled with the states and 
parameters. The parameters 0(f ) evolve in an unknown way. 

The goal of prognostics is to predict EOL (and/or RUL) at 
a given time point tp using the discrete sequence of obser- 
vations up to time tp, denoted as yo-.t P - EOL is defined as 
the time point at which the component no longer meets a 
functional or performance requirement. In general, these re- 
quirements do not need to be directly tied to permanent fail- 
ure, rather, they refer to a state of the system that is undesir- 
able. The system can leave this state through repair or other 
actions, and sometimes no action is needed and the compo- 
nent needs only to rest (e.g., with power electronics, or self- 
recharge of batteries). These functional requirements may be 
expressed through a threshold, beyond which the component 
is considered to have failed. In general, we may express this 
threshold as a function of the system state and parameters, 
T E OL{^{t),G(t)), where T EOL (x(t),0(t)) = 1 if a require- 
ment is violated, and 0 otherwise. 

So, EOL may be defined as 

EOL{tp) = inf{t £ R : t > tp A T S o i/ (x(f), 0(/)) = 1}, 


the EOL or RUL. We compute, at time tp, p(EOL(t p )\yw.t P ) 
or p{RUL(tp)\yo:t P ). 

In model-based prognostics, there are two fundamental prob- 
lems: (0 joint state-parameter estimation, and (if) predic- 
tion. In discrete time k, we estimate x/ {; and 9 k , and use 
these estimates to predict EOL and RUL at desired time 
points. The model-based prognostics architecture is shown in 
Fig. 1 (Daigle & Goebel, 2011). Given inputs u/ ;: , the system 
provides measured outputs y*.. If available, a fault detection, 
isolation, and identification (FDII) module may be used to 
determine which damage mechanisms are active, represented 
as a fault set F. The damage estimation module may use 
this result to limit the dimension of the estimation problem. 
It determines estimates of the states and unknown parame- 
ters, represented as a probability distribution p(x k , 0fc|yo : fc)- 
The prediction module uses the joint state-parameter distribu- 
tion, along with hypothesized future inputs, to compute EOL 
and RUL as probability distributions p(EOL kp \yo :kp ) and 
p(RUL kp lyoifep) at given prediction times kp. In this paper, 
we assume a solution to FDII that provides us with the single 
active damage mechanism, initiating prognostics. 

Prognostics performance is evaluated based on the accuracy 
and precision of the predictions. We use the relative accuracy 
(RA) metric (Saxena, Celaya, Saha, Saha, & Goebel, 2010) to 
characterize prediction accuracy. For a given prediction time 
kp, RA is defined as 


RAfcp = 100 1 - 


I RUL* kp - RUL kf 


RUL* 


where RUL* kp is the true RUL at time kp, and RUL kp is the 
mean of the prediction. The prognostic horizon (PH) refers 
to the time between EOL and the first prediction that meets 
some accuracy requirement RA* (e.g., 90%): 

= lm EOL* - minjfcp : RA kp > RA* } 

EOL* 

where EOL* denotes the true EOL. A larger value means an 
accurate prediction is available earlier. This is a version of the 
PH metric given in (Saxena et al., 2010) normalized to EOL. 
Prediction spread is computed using relative median absolute 
deviation (RMAD): 


RMAD(AT) = 100 


Median j (|2Q — Median^ (X,-)|) 
Median j (Xj ) 


where X is a data set and Xj is an element of that set. 


3. Pump Modeling 


i.e., EOL is the earliest time point at which the threshold is 
reached. RUL may then be defined with 

RUL(t P ) = EOL(t P ) - t P . 

Due to various sources of uncertainty, including uncertainty in 
the model, the goal is to compute a probability distribution of 


In our modeling methodology, we first describe a nominal 
model of system behavior. We then extend the model by in- 
cluding damage progression functions within the state equa- 
tion f that describe how damage variables d(f) C x(f) evolve 
over time. The damage progression functions are parameter- 
ized by unknown wear parameters w (t) C 0(f). We use 
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Figure 1 . Prognostics architecture. 


Outlet 



Figure 2. Centrifugal pump. 


a centrifugal pump as a case study. In this section, we first 
describe the nominal model of the pump, and then describe 
common damage progression models. 

3.1 Nominal Model 

A schematic of a typical centrifugal pump is shown in Fig. 2. 
Fluid enters the inlet, and the rotation of the impeller, driven 
by an electric motor, forces fluid through the outlet. The radial 
and thrust bearings help to minimize friction along the pump 
shaft. The bearing housing contains oil which lubricates the 
bearings. A seal prevents fluid flow into the bearing housing. 
Wear rings prevent internal pump leakage from the outlet to 
the inlet side of the impeller, but a small clearance is typically 
allowed to minimize friction. The nominal pump model has 
been described previously in (Daigle & Goebel, 2011), and 
we review it here for completeness. 

The state of the pump is given by 

x(f) = [w(f) T t (t) T r (t ) T 0 (t)] T , 

where u>(t) is the rotational velocity of the pump, T t (t) is the 
thrust bearing temperature, T r (t ) is the radial bearing temper- 
ature, and T a (t) is the oil temperature. 

The rotational velocity of the pump is described using a 
torque balance, 

W = J ( T e (t ) - rw(t) - T L (t)) , 

where J is the lumped motor/pump inertia, r e is the electro- 
magnetic torque provided by the motor, r is the lumped fric- 


tion parameter, and tl is the load torque. In an induction 
motor, a voltage is applied to the stator, which creates a cur- 
rent through the stator coils. A polyphase voltage applied to 
the stator creates a rotating magnetic field that induces a cur- 
rent in the rotor, causing it to turn. The torque produced on 
the rotor is nonzero only when there is a difference between 
the synchronous speed of the supply voltage, ui s and the me- 
chanical rotation, ui. This slip is defined as 

W s — U3 

s = . 

LO s 

The expression for the torque r e is derived from an equiva- 
lent circuit representation for the three-phase induction motor 
based on rotor and stator resistances and inductances, and the 
slip s (Lyshevski, 1999): 

^pR 2 ^rm.s 

sco s (i?i + R2/ s ) 2 + (w a Li + u s L 2 ) 2 ’ 

where R\ is the stator resistance, L\ is the stator inductance, 
f ?2 is the rotor resistance, L 2 is the rotor inductance, n is 
the number of phases (typically 3), and p is the number of 
magnetic pole pairs. The dependence of torque on slip creates 
a feedback loop that causes the rotor to follow the rotation 
of the magnetic field. The rotor speed may be controlled by 
changing the input frequency ui s . 

The load torque tl is a polynomial function of the pump flow 
rate and the impeller rotational velocity (Wolfram, Fussel, 
Brune, & Isermann, 2001; Kallespe, 2005): 

t l = a 0 uj 2 + aicoQ — a 2 Q 2 , 

where Q is the flow, and do, 01 , and <12 are coefficients derived 
from the pump geometry (Kallespe, 2005). 

The rotation of the impeller creates a pressure difference from 
the inlet to the outlet of the pump, which drives the pump flow, 
Q. The pump pressure is computed as 

Pp = Auj 2 + b\LoQ — &2Q 2 ; 

where A is the impeller area, and b\ and 62 are coefficients 
derived from the pump geometry. The discharge flow, Q, is 
comprised of the flow through the impeller, Qi, and a leakage 
flow, Qp 

Q Qi Ql- 
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The flow through the impeller is computed using the pressure 
differences: 

Qi = CyJ\p s + P p ~ Pd\sign(p s +p p -p d ), 

where c is a flow coefficient, p s is the suction pressure, and 
Pd is the discharge pressure. The small (normal) leakage flow 
from the discharge end to the suction end due to the clearance 
between the wear rings and the impeller is described by 

Qi = ci\/\pd-ps\sign(jpd ~p s ), 

where c; is a flow coefficient. 

Pump temperatures are often monitored as indicators of pump 
condition. The oil heats up due to the radial and thrust bear- 
ings and cools to the environment: 


1 

Z ( 


where J a is the thermal inertia of the oil, and the H or terms 
are heat transfer coefficients. The thrust bearings heat up due 
to the friction between the pump shaft and the bearings, and 
cool to the oil and the environment: 
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Figure 3. Nominal pump operation. 


f t = Jryu 2 - H t>1 (T t - T 0 ) - H ta (T t - T a )), 

■>t 

where J t is the thermal inertia of the thrust bearings, r f is the 
friction coefficient for the thrust bearings, and the // t t terms 
are heat transfer coefficients. The radial bearings behave sim- 
ilarly: 

T r = J“( r rW 2 - H r ,i(T r - T 0 ) - H rt2 (T r - T a )) 

where J. r is the thermal inertia of the radial bearings, r> is the 
friction coefficient for the radial bearings, and the //, , terms 
are heat transfer coefficients. 

The overall input vector u is given by 

u (t) = [p s (t) p d (t) T a (t) V(t) w s (f)] J . 

The measurement vector y is given by 

y(t)=[uj(t) Q(t) T t (t) T r (t) T 0 (t)] T . 

Fig. 3 shows nominal pump operation. Input voltage and line 
frequency are varied to control the pump speed. Initially, slip 
is 1, and this produces an electromagnetic torque that causes 
the rotation of the motor to match the rotation of the magnetic 
field, with a small amount of slip remaining (depending on 
the load). Fluid flows through the pump due to the impeller 
rotation. The bearings heat and cool as the pump rotation 
increases and decreases. 


3.2 Damage Modeling 

The most significant forms of damage for pumps are impeller 
wear, caused by cavitation and erosion by the flow, and bear- 
ing failure, caused by friction-induced wear of the bearings. 
In each case, we map the damage to a particular parameter 
in the nominal model, and this parameter becomes a damage 
variable in d ( t ) that evolves by a damage progression func- 
tion. Several types of damage progression models have been 
explored in literature. In this paper, we focus on macro-level, 
lumped-parameter models. Within this modeling style, dam- 
age evolves as a function of dynamic energy-related variables. 
Several common forms may be assumed here, including lin- 
ear, polynomial, and exponential, as these forms have been 
observed in practice. We derive these forms for the consid- 
ered damage modes as well as wear-based models based on 
physics analysis. 

Impeller wear is represented as a decrease in impeller area 
A (Biswas & Mahadevan, 2007; Tu et al., 2007; Daigle & 
Goebel, 2011). Impeller wear can only progress when flow 
through the impeller, Qi, is nonzero. So, the rate of change of 
impeller area. A, must be a function of Qi. We consider the 
following damage progression models based on the common 
observed forms: 

A = -w A Qi (l) 

A = -waQI (2) 

A = -WAlQi - WA 2 Q 2 (3) 

A = -WA1 exp( [w A 2Qi), (4) 
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where wa, wai, and wa 2 are unknown wear parameters. 
From a physics analysis, we see that the erosive wear equation 
applies here (Hutchings, 1992). The erosive wear rate is pro- 
portional to fluid velocity times friction force. Fluid velocity 
is proportional to volumetric flow rate, and friction force is 
proportional to fluid velocity, so, lumping the proportionality 
constants into the wear coefficient wa* we obtain 

A = -w A Ql (5) 

Note that this agrees with one of the commonly assumed dam- 
age forms, equation 2, above. 

A decrease in the impeller area will decrease the pump pres- 
sure, which, in turn, reduces the delivered flow, and, therefore, 
pump efficiency. The pump must operate at a certain minimal 
efficiency. This requirement defines an EOL criteria. We de- 
fine A~ as the minimum value of the impeller area at which 
this requirement is met, hence, Teol = 1 if A(t) < A~ . 

The damage progression up to EOL for impeller wear is 
shown in Fig. 4a for equation 5, for the rotational velocity 
alternating between 3600 RPM for the first half of every hour 
of usage and 4300 RPM for the second half, causing the pump 
flow to alternate as well. Within a given cycle, shown in the 
inset of Fig. 4a, the damage progresses at two different rates, 
but over a long time horizon, the damage progression appears 
fairly linear. This suggests that a linear approximation may 
suffice for accurate long-term predictions if the future inputs 
cycle in the same way. The damage progression rate actu- 
ally decreases slightly over time, because as impeller area de- 
creases, flow will decrease, and therefore A will diminish. 
Bearing wear is captured as an increase in the corresponding 
friction coefficient (Daigle & Goebel, 2011). Bearing wear 
can only occur when the pump is rotating, i.e., oj is nonzero. 
So, the rate of change of the bearing friction coefficient, r t 
for the thrust bearing, and f r for the radial bearing, must be 
a function of lo. For the thrust bearing wear, we consider the 
following damage progression models based on the common 
observed forms: 


f t (f) = W t UJ 

(6) 

r t (t) = w t uj 2 

(7) 

r t (t) — w t iw + w t 2 W 2 

(8) 

r t (t) = Wti exp(wt 2 w), 

(9) 


where wt, Wti, and Wti are unknown wear parameters. For 
the radial bearing, the equations are the same, but with the t 


subscript replaced by an r subscript: 

fy(i) = w r oj (10) 

f r (t)=w r uj 2 (11) 

fy(i) = w r iLO + w r 2 to 2 (12) 

fy(i) = w r i exp(w r 2 <jj). (13) 


From a physics analysis, we observe that sliding and rolling 




(b) Damage progression for thrust bearing wear. 



Figure 4. Damage progression for the pump. 

friction generate wear of material which increases the coeffi- 
cient of friction (Hutchings, 1992; Daigle & Goebel, 2010): 

f t {t) = w t r t J 1 (14) 

r r (t) = w r r r uj 2 , (15) 

where w t and w r are the wear parameters. Note that equa- 
tions 6-9 neglect the direct relationship between r t and r t . 
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Changes in bearing friction can be observed by means of the 
bearing temperatures. Limits on the maximum values of these 
temperatures define EOL for bearing wear. We define r, 1 and 
r+ as the maximum permissible values of the friction coeffi- 
cients, before the temperature limits are exceeded over a typ- 
ical usage cycle. So, Teol = 1 if r t (t) > r f or r r {t) > r+. 
Damage progression up to EOL for bearing wear is shown in 
Figs. 4b and 4c, for equations 14 and 15, with the rotational 
velocity again alternating between 3600 RPM and 4300 RPM. 
In this case, the rate of damage progression increases over 
time. Therefore, a simple linear approximation would not be 
accurate. This behavior occurs because r t (t) increases with 
r t (f), and fy(i) increases with r r (t). 

4. Model Abstraction 

The previous section presented a number of different models. 
In general, these differences may be captured by the idea of 
model abstraction (Frantz, 1995; Lee & Fishwick, 1996; Zei- 
gler, Praehofer, & Kim, 2000). Abstraction is driven by the 
questions that the model must address. For prognostics, the 
models must address the question of the EOL/RUL of a sys- 
tem. In order to do this, the models must (i) describe how 
damage manifests in the system outputs (i.e., measured vari- 
ables or computed features), so that damage estimation can 
be performed; and (ii) describe how damage evolves in time 
as a function of the system loading, so that prediction can be 
performed. The chosen level of model abstraction must be 
such that these tasks can be accomplished at the desired level 
of performance. 

Abstraction is a process of simplification. Common ab- 
stractions include aggregation, omission, linearization, de- 
terministic/stochastic replacement, and formalism transfor- 
mation (e.g., differential equations to discrete-event sys- 
tems) (Zeigler et ah, 2000). These abstractions may manifest 
as structural abstraction , in which the model is abstracted by 
its structure, or behavioral abstraction, in which the model 
is abstracted by its behaviors (Lee & Fishwick, 1996). For 
example, a structural abstraction might ignore the individual 
circuit elements of an electric motor and aggregate them into 
a lumped component. A behavioral abstraction might omit 
the individual processes and effects comprising a damage pro- 
gression process and instead consider their lumped effects. 
Or, perhaps a given process might really take on an exponen- 
tial form, but is abstracted to a linear form. The linear form 
consists of a simpler relationship that is described by fewer 
free parameters. 

Model granularity is a particular measure of model abstrac- 
tion. The granularity of a model is the extent to which it is 
divided into smaller parts. The concept of granularity does 
not address the degree of complexity of the specific func- 
tional relationships within a part of the model. Granularity 
can manifest both structurally and behaviorally. For exam- 
ple, a lumped parameter model is coarser-grained than a fi- 


nite element model. In the context of physics-based prognos- 
tics models, a model with fine granularity may include more 
lower-level physical processes (e.g., micro-level effects rather 
than macro-level effects), or model processes at a greater level 
of detail, than a model with coarse granularity. 

In quantifiable terms, granularity may be expressed using 
the number of state variables, the number of relationships 
between them, and the number of free (unknown) parame- 
ters. By definition, the state variables are the minimal set 
of variables needed to describe the state of the system as it 
progresses through time. So a finer-grained model may en- 
tail an additional number of state variables because aspects 
of the physical description that were not captured before are 
now described. With the same state variables, a model may 
also become more granular by adding functional relation- 
ships between the state variables. In a linear system, with 
x(f) = A x(f) + Bu(f), this would correspond to zeros in 
the A matrix becoming nonzero. Note that this is only a fair 
comparison between two models capturing the same process. 

The different damage models developed in Section 3.2 can be 
viewed within this framework. For a particular damage mode, 
the different damage models each capture the same physical 
process, i.e., the damage progression, but make different as- 
sumptions about the complexity of the process. Thus, these 
models capture damage progression at different levels of be- 
havioral abstraction. For example, for the impeller wear, the 
polynomial form (equation 3) may be viewed as less abstract 
than both the linear (equation 1) and squared forms (equa- 
tion 2), because it is a sum of these individual processes. For 
the bearing wear, equations 6-9 are all coarser-grained mod- 
els than 14, because they neglect the direct relationship be- 
tween ft and rt- 

One may describe the system behavior in very low-level phys- 
ical relationships, but, of course, there are trade-offs to be 
made among the modeling constraints. A finer-grained model 
takes more effort to develop and validate, and may result in 
an increased computational cost. It also may result in an 
increase in the number of free parameters, which increases 
the complexity of the joint state-parameter estimation prob- 
lem. The increase in model development cost to create mod- 
els with finer granularity is justified only when it results in 
an appropriate increase in fidelity (i.e., the extent to which 
a model reproduces the observable behaviors of the system 
being modeled) and a corresponding increase in prognostics 
performance. Also, higher levels of abstraction make sense 
when the computation associated with lower levels of abstrac- 
tion becomes too complicated for practical implementation. 
Requirements on prognostics performance and constraints on 
model size, development cost, level of modeling expertise, 
and computational complexity all drive the model develop- 
ment process. 
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5. Damage Estimation 

Damage estimation is fundamentally a joint state-parameter 
estimation problem, i.e., computation of p(x k , Ok\yo:k)- The 
damage states and wear parameters must be estimated along 
with the other state variables and unknown parameters of the 
system. We use the particle filter (Arulampalam, Masked, 
Gordon, & Clapp, 2002) as a general solution to this problem. 

In a particle filter, the state distribution is approximated by a 
set of discrete weighted samples, or particles: 

{(x^ fe W-h= 1, 

where N denotes the number of particles, and for particle i, 
xj, denotes the state vector estimate, 0] denotes the parameter 
vector estimate, and w\ denotes the weight. The posterior 
density is approximated by 

N 

p(x fc ,0fc |y 0 :fc) « ^wis^ ^idxkddk), 

i— 1 

where S( x % e i\(chckdOk) denotes the Dirac delta function lo- 
cated at (x|, 0\). 

We use the sampling importance resampling (SIR) particle fil- 
ter. Each particle is propagated forward to time k by first sam- 
pling new parameter values, and then sampling new states us- 
ing the model. The particle weight is assigned using y/ i: . The 
weights are then normalized, followed by the resampling step. 
Pseudocode is given in (Arulampalam et al., 2002; Daigle & 
Goebel, 2011). 

Parameter values are sampled using a random walk, i.e., for 
parameter 9, 6k = 9k - i + £fc-i, where Gc-i is sampled from 
some distribution. Particles generated with parameter values 
closest to the true values should be assigned higher weight 
and allow the particle filter to converge to the true values. 
The random walk variance is modified dynamically online 
to maintain a user-specified relative spread of the unknown 
wear parameters using the variance control algorithm pre- 
sented in (Daigle & Goebel, 2011). The algorithm increases 
or decreases the random walk variance proportional to the 
difference between the desired spread and the actual spread, 
computed with relative median absolute deviation (RMAD). 
The algorithm behavior is specified using four parameters; 
the desired spread during the initial convergence period, Vq 
(e.g., 50%), the threshold that specifies the end of the con- 
vergence period, T (e.g., 60%), the final desired spread v ^ 
(e.g., 10%), and the proportional gain P (e.g. 1 x 10 -3 ). The 
spread is first controlled to Vq until the spread reaches T, at 
which point it is controlled to v ^ . 

6 . Prediction 

Given the current joint state-parameter estimate at a desired 
prediction time kp, p(x kp , 0 kp |yo:fc P ), the prediction step 


computes p(EOL kp |yo : fc.p) and p(RUL kp \y 0:kp ). The par- 
tide filter provides 

N 

p{x kp ,0 kp \y O:kp ) « '^2w l kp 5 [x i k ^ ^ k ^(dx kp d0 kp ). 

i= 1 

We approximate a prediction distribution n steps forward 
as (Doucet, Godsill, & Andrieu, 2000) 

Pfa-kp+m @kp+n |y0:fcp ) ~ 

N 

^ y W kp^(Xk p +niOkp+n) (^ Xfc P+ n ^^P+ n )* 
i= 1 

Similarly, we approximate the EOL as 

N 

p(EOL kp |yo: fcf> ) « ^2 wl p S EOL i kp ( dEOL kp ). 

i - 1 

To compute EOL, then, we propagate each particle forward 
to its own EOL and use that particle’s weight at kp for the 
weight of its EOL prediction. The prediction is made using 
hypothesized future inputs of the system. In this work, we 
assume these inputs are known in advance. Pseudocode for 
the prediction algorithm is given in (Daigle & Goebel, 201 1). 

7. Results 

We ran a number of simulation experiments for the different 
pump models in order to evaluate the relative performance. 
We took the damage models using the physics-based wear 
equations as the reference models that generated the measure- 
ment data. The model used by the prognostics algorithm was 
either the reference model Mi (using equations 5, 14, and 
15), the linear model Ml Linear (using equations 1, 6, and 

10) , the squared model Ml squared (using equations 2, 7, and 

11) , the second order polynomial model Ml p 0 i y (using equa- 
tions 3, 8, and 12), or the exponential model Ml Exp (using 
equations 4, 9, and 13). In each experiment, the pump speed 
cycled from 3600 RPM for the first half of every hour of usage 
to 4300 RPM for the second half hour. 

In order to analyze results on a per-damage mode basis, in 
each experiment we assumed only a single damage mode was 
active. We selected the reference model’s wear parameter val- 
ues randomly in each experiment, within [0.5 x 10~ 3 ,4 x 
10~ 3 ] for wa, in [0.5 x 10 — 11 , 7 x 10 -11 ] for Wt and w r , 
such that the maximum wear rates corresponded to a mini- 
mum EOL of 20 hours. The particle filters had to estimate 
the states and the wear parameters associated with their as- 
sumed damage progression models. We considered the case 
where the future input was known in order to focus on the dif- 
ferences in performance based on the different assumed dam- 
age models. We also varied the process noise variance from 
0, to nominal, and 10 times nominal, in order to artificially 
represent the nominal model at various levels of granularity. 
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Model 

V 

RA 

RMAD/;;//, 

M 

0 

97.87 

10.33 


l 

97.42 

10.30 


10 

97.63 

10.41 

Linear 

0 

94.12 

10.42 


l 

92.28 

10.91 


10 

83.68 

12.42 

A4p 0 ly 

0 

97.55 

3.35 


l 

96.97 

6.62 


10 

89.98 

10.55 

•M-Exp 

0 

87.27 

12.87 


1 

88.83 

13.01 


10 

81.78 

12.90 


Table 1 . Prognostics Performance for Impeller Wear 


The assumption here is that the process noise represents finer- 
grained unmodeled processes that are not incorporated into 
the model and therefore look like noise. 

Prognostics performance is dependent on both the underlying 
models used and on the prognostics algorithm. In order to 
focus on the dependence on modeling, we fix the algorithm 
and its parameters. The particle filter used N = 500 in all 
cases. The variance control algorithm used = 50%, T = 
60%, = 10% in all cases, and used P = lx 10~ 3 for 

the damage models with one unknown wear parameter and 
P = lx 10 -4 for those with two unknown wear parameters. 
The prognostics performance results for impeller wear us- 
ing different damage models and different levels of process 
noise variance are shown in Table 1. The process noise vari- 
ance multiplier is shown in the second column of the table. 
We average RA over all prediction points to summarize the 
accuracy, denoted using RA, and we average RMAD over 
all prediction points to summarize the spread, denoted using 
RMAD mil,- Multiple experiments were run for each case, 
and the table presents the averaged results. We can see that 
the linear damage model actually does fairly well. Its per- 
formance decreases as process noise increases, but for small 
amounts of process noise the accuracy is over 90%. The poly- 
nomial model also does well, which is expected since the sec- 
ond term by itself is the reference damage model. The particle 
filter still estimates a linear component which tracks damage 
progression over a short term fairly well, and it is the pres- 
ence of this linear term that causes the accuracy to decrease. 
The exponential model does not do as well, partly because the 
behavior is very sensitive to the wear parameter inside the ex- 
ponential function, WA 2 , and so estimating both wear param- 
eters simultaneously is more difficult for the particle filter. 
The estimation performance using the reference model and 
the linear model is compared in Fig. 5. In both cases, the 
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Figure 5. Impeller wear parameter estimation. 



damage variable. A, was tracked well. When using the same 
damage model as in the reference model, the wear parameter 
is tracked easily and after convergence remains fairly con- 
stant. As a result, the predictions, shown in Fig. 6, using the 
mean, denoted by RU L, are very accurate and appear within 
10% of the true value at all prediction points (shown using the 
gray cone in the figure). Because the rate of damage progres- 
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Figure 7. Impeller wear damage progression prediction, 
where at tp, Qi increases by 30%. 


sion in the reference model decreases slowly over time, and 
the linear model does not accurately capture that behavior, its 
wear parameter estimate decreases over time in order to keep 
tracking the short-term damage progression. This is reflected 
also in the RUL predictions. Although the RUL accuracy is 
also very good, it is clear that it consistently underestimates 
the true RUL, because at any point in time it is overestimating 
the rate of damage progression that would occur in the future. 
However, the prognostic horizon is still very high. As shown 
in Fig. 6, by the second or third prediction, the predictions 
are all within the desired accuracy cone, except for the expo- 
nential model, which has PH of around 60%, meaning that at 
60% life remaining, the exponential model is making accurate 
predictions. In many practical situations that may, in fact, be 
enough time for decision-making. 

For impeller wear, the linear model does well in this case 
because the future loading is the same as the current load- 
ing. If Qi is held constant, then the reference damage model 
A = waQI, which equals ( waQAQi , looks exactly like the 
linear form because the product waQi is constant. So the 
particle filter would estimate a wear parameter for the linear 
model that is the product of the wear parameter for the ref- 
erence model multiplied by Qi. So under constant loading, 
the linear model, or any other damage model that predicts a 
constant A under uniform loading, will produce accurate pre- 
dictions. But, if the future loading is different than the current 
loading, then the product waQi will change and the wear pa- 
rameter estimated for the linear model will no longer be valid. 
This is illustrated in Fig. 7. At tp, Qi increases by 30%. The 
algorithm using the reference damage model captures the re- 
lationship between A and Qi consistently with the simulation, 
and predicts EOL to be a little over 25 hours. In contrast, the 
linear model overestimates the RUL, because its wear param- 
eter was tuned to the previous value of Qi, and results in a 
RA of only around 80%. So for complex loading situations, 
it is important to correctly capture the relationship between 
loading and damage progression. 


Model 

V 

RA 

RMAD/jj/i 

M 

0 

97.80 

11.61 


i 

97.57 

11.43 


10 

97.50 

11.18 

Linear 

0 

79.93 

10.72 


1 

83.93 

10.79 


10 

82.45 

9.41 

Squared 

0 

78.05 

11.59 


1 

79.68 

12.15 


10 

74.59 

11.17 

Aipoly 

0 

78.43 

6.07 


1 

78.94 

9.09 


10 

76.48 

11.76 

A^Exp 

0 

82.34 

9.23 


1 

79.87 

12.43 


10 

69.37 

21.32 


Table 2. Prognostics Performance for Thrust Bearing Wear 

The prognostics performance results for thrust bearing wear 
using different damage models and different levels of process 
noise variance are shown in Table 2. Results for radial bearing 
wear are similar, since the same damage models were used, 
and are omitted here. For the thrust bearing wear, only the 
case using the correct damage model obtains reasonable ac- 
curacy. The estimation results for some of the damage models 
are shown in Fig. 8. In all cases, the damage variable, r t , was 
tracked well. With the algorithm using the reference damage 
model, the wear parameter is tracked well and after conver- 
gence remains approximately constant. In contrast, the lin- 
ear model does not capture the relationship with ui correctly 
(i.e., in the reference model it is really a function of ui 2 ). so 
as ui changes between the two RPM levels, the estimate of 
the wear parameter must constantly increase and decrease to 
correctly track the damage progression. Further, because the 
rate of damage progression in the reference model increases 
over time (since it is a function of r t ), and the linear model 
does not capture that behavior, its wear parameter estimate 
must increase over time. With the polynomial model also, 
the parameter estimates do not take on constant values. This 
is also due partly to the fact that a wide number of pairs of 
Wt\ and Wp 2 , i.e., multiple solutions to the damage progres- 
sion equation, can track the short-term damage progression 
well. Hence, the wear parameter estimates can change over 
the long-term while still tracking short-term, leading also to 
an increased variability in the prediction accuracy. 

The prediction performance is compared in Fig. 9. The algo- 
rithm using the reference model obtains accurate predictions. 
On the other hand, the other models consistently overestimate 
the RUL, because at any point in time they are underesti- 
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Figure 8. Thrust bearing wear parameter estimation. 


mating the rate of damage progression that would occur in 
the future. So, early on, the predictions are overly optimistic 
and could result in poor decisions based on that information. 
These models also produce very similar predictions. For the 
reference model AT PH is around 95%, but for the remaining 
models, PH is around 30% or worse, so, for these models, ac- 
curate predictions are only being obtained with less than 30% 
life remaining, as observed in Fig. 9. 

Note also that as the process noise increased, the algorithm 
using the reference model had only small decreases in perfor- 
mance, whereas for the other models, performance decreased 
quite significantly. In this case it was more difficult for the 
particle filters using these models to track damage over the 



t (hours) 


Figure 9. Thrust bearing RUL prediction performance. 

short term, which resulted in a greater variation in the wear 
parameter estimates, leading to large decreases in accuracy. 
Overall, this analysis illustrates the trade-off in the develop- 
ment of models of damage progression. In some cases, sim- 
ple, more abstract or less granular models may suffice, es- 
pecially if the system load remains constant. But with more 
complex operational scenarios, the need for a damage model 
that accurately captures the relationship with the load is nec- 
essary. In the case of the thrust bearing wear, even though the 
current and future inputs were the same, the fact that all of the 
less granular models did not account for the relationship be- 
tween ft and r t , which caused the damage progression rate to 
increase over time, resulted in poor prognostics performance, 
even for the more complex models. The more complex mod- 
els, i.e., those with more unknown wear parameters, allowed 
more flexibility to correctly approximate the correct damage 
progression function, but this also increased the dimension 
of the joint state-parameter space and made estimation more 
difficult. 

8. Conclusions 

We presented a model-based prognostics methodology, and 
investigated the effect of the choice of damage progression 
models on prognostics performance. In prognostics mod- 
eling, accurate damage progression models are crucial to 
achieving useful predictions. Using a centrifugal pump as a 
simulation-based case study, we developed several different 
damage progression models, and, assuming some physics- 
based wear equations as the reference form, compared the 
performance of the prognostics algorithm using the different 
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models. In some cases, such as under cyclic or constant load- 
ing, it was shown that simple linear models may suffice. Some 
models also performed poorly early on but achieved accurate 
predictions before 50% life remaining. But, omitting addi- 
tional interactions within the damage progression models may 
cause inaccurate results, even under simple loading scenar- 
ios. Further, even though the prognostics algorithm was ro- 
bust enough to track the damage with all the different models, 
this did not translate to accurate predictions when a different 
damage progression model was used relative to the reference 
model. 

In future work, we will extend this analysis to other domains 
such as electrochemical systems and electrical devices, in 
order to establish general design guidelines for prognostics 
models. For a desired level of prognostics performance, we 
want to be able to determine what level of model granularity 
is necessary. These ideas also apply to data-driven models, 
and models for diagnosis, which will be addressed in future 
work as well. 
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